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Abstract 

We consider complete synchronization of identical maps coupled through a gen- 
eral interaction function and in a general network topology where the edges may be 
directed and may carry both positive and negative weights. We define mixed trans- 
verse exponents and derive sufficient conditions for local complete synchronization. 
The general non-diffusive coupling scheme can lead to new synchronous behavior, in 
networks of identical units, that cannot be produced by single units in isolation. In 
particular, we show that synchronous chaos can emerge in networks of simple units. 
Conversely, in networks of chaotic units simple synchronous dynamics can emerge; 
that is, chaos can be suppressed through synchrony. 

Mathematics Subject Classification: 05C50, 37D45, 37E05, 39A11 

PACS numbers : 05.45.-a, 05.45.Ra, 05.45.Xt 

1 Introduction 

Synchronization in complex networks has been studied extensively by many scientists in 
the past years (for recent reviews see [3 HI Specific application areas include social 
networks (opinion formation, finance, and world trade web), biological networks (genetic 
networks, cardiac rhythms, and neural networks), and technological networks (wireless 
communication networks and power-grids); see pj and the references therein. Synchro- 
nization is one particular collective behavior in complex networks that emerges through 
the interaction of the constituent units. Complex systems are generally characterized by 
the richness of emergent behavior arising from the interaction of many elements or agents, 
which themselves are typically rather simple and often interact only locally or with only 
a few other ones. How dynamically rich behavior can emerge in a network of simple units 
is an important general question in complexity. In this article, we study the relation of 
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the concept of emergence to synchronizatioiu, in the setting of coupled identical map 
networks. 

Coupled map networks introduced by Kaneko [1] have become one of the standard 
models in synchronization studies. Particularly, chaotic synchronization can be investi- 
gated already in simple one-dimensional maps, which, as is well-known, would require at 
least three dimensions in the continuous-time case. On the one hand, a chaotic system's 
sensitive dependence to initial conditions would tend to lead the coupled system away 
from synchrony in the presence of ever-so-small perturbations. On the other hand, a 
diffusive coupling d between the units tends to equalize the states of neighboring units by 
providing a driving force that grows with the difference of the states, thereby driving the 
system towards synchrony. In the interplay between these two effects, it has indeed been 
discovered that diffusively coupled chaotic systems can exhibit robust synchronization for 
an appropriate range of parameters. Synchronization in diffusively-coupled map networks 
with positive weights is now well understood: One finds that the synchronizability of the 
network depends on the underlying network topology (given by the eigenvalues of the 
coupling matrix) and the dynamical behavior of the individual units (given by the largest 
Lyapunov exponent) [SI [6]. 

A notable aspect of diffusively coupled systems of identical units is that, while diffusive 
coupling tends to drive the network towards synchrony, the synchronized network shows 
exactly the same dynamical behavior as a single isolated unit. This is a simple consequence 
of the fact that the coupling term vanishes at the synchronized state. Hence, normally 
no new behavior arises through synchronization of diffusively-coupled systems. A notable 
exception is in the presence of time delays: It has been discovered that networks with 
time delays not only are able to synchronize (in fact sometimes better than undelayed 
networks), but also can exhibit a very rich range of new synchronized behavior [71 [5]. 

However, new synchronized behavior can not only be observed in diffusively coupled 
networks, when time-delays are present. In this work we show that also in non-diffusively 
coupled networks new synchronized behavior is emerging. The focus of this work is to 
understand, in detail, the impact of non-diffusive coupling schemes on the synchronized 
behavior. The synchronized behavior of a non-diffusively coupled network can be very 
different from the individual dynamics of its components (units) . In contrast to diffusively- 
coupled networks, the overall coupling strength does not only determine the robustness 
of the synchronous state but also the emerging synchronous dynamics, i.e. by changing 
the overall coupling strength, different synchronous dynamics can be exhibited by the 
same system. In particular we shall see the following two extreme cases. Synchronized 
chaos can emerge in networks of simple units and chaos can be suppressed in a network 
of chaotic units. 



2 General pairwise coupling 

We consider a network of identical units that interact with each other. The coupling 
topology will affect the resulting dynamics in such a network. In many real world appli- 
cations the connection structure is not bidirectional. Furthermore the influence of other 
units can be excitatory or inhibitory. These phenomena can, for example, be observed 

^There exits several notions of synchronization [3]- In this work we study complete synchronization, 
where the differences between the states of coupled units tend to zero. 

^Diffusive coupling refers to a coupling function that vanishes whenever its arguments are the same, 
see l[2]l. 
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in neural networks, where there exists excitatory and inhibitory synapses and only the 
pre-synaptic neuron influences the post-synaptic one but not vice versa. Examples of syn- 
chronization in simple models of neural networks are investigated in [3] . Since different 
networks interact through different interaction functions, we want to keep our coupling 
function sufficiently general. Taking all these requirements into account, we study the 
following network model. 

Let r be a non-trivial, weighted, directed graph on n vertices. The weight of the 
connection from vertex j to vertex i is denoted by Wy, which could be positive, negative 
or zero. Positive and negative weights could model, for instance, excitatory and inhibitory 
connections, respectively. We assume that the network has no self-loops, that is, wu = 
for all i. The in-degree of vertex i is denoted by di = X]j"=i^y - Even if a vertex 
is not isolated, it is possible that the in-degree of this vertex is equal to zero because 
of cancellations between positive and negative weights. These vertices are called quasi- 
isolated vertices, because their properties are very similar to isolated vertices [TD]. Note 
that by definition every isolated vertex is quasi-isolated. In the following we will identify 
each unit with a vertex of a graph. This correspondence allows us to make use of graph 
theoretical methods. 

The activity at vertex or unit i at time ^ + 1 is given by: 

n 

Xi{t + 1) = f{xi{t)) + eai^Wijg{xi{t),Xj{t)) i = l,...,n, (1) 

where 

r i if 

' \ ff = 0, 

/ : K. ^ M and 5 : ^ M are differentiable functions, and e G M is the overall coupling 
strength. In the following we assume that the derivatives of / and g are bounded along 
synchronous solutions s{t) of system ([ij, where all units exhibit the same behavior for all 
time i.e., 

Xi{t) — s{t) \fi, t. 

The function / describes the dynamical behavior of the individual units whereas g char- 
acterizes the interactions between different pairs of units. 

We say that the interaction is diffusive if the coupling function g satisfies the general 
diffusion condition 

gix^x) =0 Vx e M. (2) 

A synchronous solution always exists if the interaction function g satisfies Under 
this assumption the dynamical behavior of the whole network is exactly the same as the 
dynamical behavior of the isolated units, that is, 

sit + l) = f{s{t)). (3) 

However, if ^ is not satisfied then a synchronous solution may not always exist. Indeed, 
if s{t) is a synchronous solution such that g(s{t), s{t)) ^ for some t, then ([T]) implies 
that either cr^ = for all i, or ^0 for all i. In other words, a synchronized solution 
exists only if all vertices are quasi-isolated or none of them are. The first case is trivial 
as there is no interaction. Therefore, for the study of emergent dynamics when ^ is not 
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satisfied, we shall later on restrict ourselves to the second case, i.e., to networks without 
quasi-isolated vertices. For such networks synchronous solutions exist and satisfy 

s{t + l) = f{s{t)) + eg{s{t),s{t)). (4) 

Eq. Q already shows that the synchronous behavior of the network is different from the 
behavior of isolated units. However, at this point it is not clear whether a synchronized 
state is robust against perturbations. We will study this issue in some detail in the 
following sections. 

It is important to note that the interactions between the different units in Eq. ([1]) are 
"normalized" by the factor at. Otherwise a synchronous solution would only exist, in the 
non-diffusive case, under the assumption that all vertices have the same vertex in-degree. 
Consequently a synchronous solution would only exist for regular graphs. 



3 The coupling matrix 

For diffusively coupled networks, the graph Laplacian is the natural coupling matrix. For 
a directed, weighted graph without loops, the (normalized) graph Laplacian C is defined 
as, 

{1 ii i = j and di ^ 0. 
— ^ if there is a directed edge from j to i and di ^ 0. 
otherwise. 

Here in the more general coupling case, the natural coupling matrix is given by K, where 
K for a directed, weighted network without loops, is defined as 

{1 if i = j and di — 0. 
^ if there is a directed edge from j to i and di ^ 0. 
otherwise. 

Let the eigenvalues of K and C be labeled as Ai, A„ and A'^, AJ^, respectively. Since 
the row sums of K are equal to 1, K has always an eigenvalue equal to 1, which corresponds 
to the eigenvector e = (1, 1)^. 

We briefly discuss the relationship between the coupling matrix K and the graph 
Laplacian C for directed weighted graphs. The graph Laplacian C and the coupling 
matrix K are related to each other by 

C = I K, 

where I is the n x n identity matrix. Thus we have 

A^-l-A„ Vz. (5) 

Hence the multiplicity of the zero eigenvalue of £ is equal to the multiplicity of the 
eigenvalue A = 1 of K. 

The spectral properties of C and K for directed graphs with mixed signs are inves- 
tigated systematically in [1^. The presence of directed edges or mixed signs leads to 
some interesting differences in the spectrum of C compared to the case of undirected 
edges and nonnegative weights. For convenience of the reader, we mention here some of 
these differences. For undirected graphs with nonnegative weights it is well-known that 
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all eigenvalues of C are real However, this is not true anymore if one studies directed 
graphs or mixed signs. Furthermore, while in the case of only nonnegative weights the 
absolute values of the eigenvalues are bounded by 2 [TT] , this is no longer true for the case 
of mixed signs. Indeed, using Gershgorin's Theorem [12] we have the following estimate. 

Lemma 1. Let I){c,r) denote the disk in the complex plane centered at c and having 
radius r. Assume that there is at least one non quasi-isolated vertex (otherwise C is equal 
to the zero matrix). Then all eigenvalues of the graph Laplacian C are contained in the 
disk r), where 



Y.'j=l\w^j\ E7=ll'^i. 

max ■ 



En 
.? = 1 ' 



max ■ 



\d^ 



(6) 



with the convention \di\ ^ ~ Q if di ~ 0. 

Note that the radius r in Eq. ([6]) can be written in the form 



where df := Ej-m >o '"'y positive in-degree and d^ := Ej-tu <o negative 

in-degree. So, for fixed sum df + d~ , the closer df and d~ are, the larger is the radius 
r. Clearly, r = 1 when the weights are nonnegative, but r can be much larger in the case 
of signed weights. The radius r will play an important role in Chapter [6] where we derive 
sufficient conditions for synchronization. 

Since we deal with a graph F with both positive and negative weights, we should make 
some notions precise. Let the weighted adjacency matrix of F be given by W = [wij]. 
Define the corresponding (usual) graph F' with adjacency matrix A — [a^] such that 
Gij = 1 if Wij ^ and = otherwise. Then we say that F is strongly connected (resp. 
has a spanning tree) if F' is strongly connected (resp. has a spanning tree). In the general 
setting of directed edges and mixed signs, a non-complete graph refers to a graph where 
there exists at least one pair of distinct vertices with no link between them. 

The multiplicity of the zero eigenvalue of C can be bounded from below by the following 
two graph properties: 

Lemma 2. Let toq be the multiplicity of the zero eigenvalue of C. 

1. Lf ni denotes the number of quasi-isolated vertices, then 

ni < TTiQ. 

2. Lf n2 denotes the minimum number of trees needed to span the graph, then 

"2 < mo. 

Proof. 1. Assume that there exists ni quasi-isolated vertices in the graph. Then, there 
exists ni rows of C that consist entirely of zeros. Consequently, C has at least ni eigen- 
values equal to zero. 

2. Assume that one needs at least n2 trees to span the whole graph. Let C be given 
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in Frobenius normal form [13j . i.e. after possibly relabeling the vertices, £ is given in the 
form 

/ £i £12 ... Cip \ 

C2 ... C2p 



C 



V 







(7) 



where the block diagonal matrices Ci correspond to the strongly connected components 
of the graph. The spectrum of C then satisfies 



spec(£) — spec(£i). 



(8) 



Since one needs 712 trees to span the whole graph, there exist n2 block matrices Ci such 
that Cij is the zero matrix for i < j < p. Thus, these n2 block matrices Ci have zero row 
sums because C has zero row sums. The result now follows from (151). □ 



4 Synchronization 

We want to study synchronous solutions of Eq. ([T]) and whether the synchronous state is 
robust to perturbations. We say the system ([T]) (locally) synchronizes if 

lim \xi{t) — Xj{t)\ = 

t—*oo 

whenever the initial conditions belong to some appropriate open selH. In this article the 
term synchronization always refers to this definition. 



4.1 General pairwise coupling and only quasi-isolated vertices 

This case is not very insightful, as Eq. ([1]) implies that there are no interactions between 
the different units. The time evolution of each unit is given by Eq. ([3]). Thus the network 
only synchronizes if nearby orbits of the function / converge, i.e. the Lyapunov exponent 

-. t+T-l 

/./:=IWt^oo^ J2 ^og\f'is{t))l (9) 

s=i 

of / is negative. Here t is chosen such that f'{s{t)) ^ for all t > t. A negative 
Lyapunov exponent implies that the trajectory s{t) is already attracting for /, and hence, 
no emergence of new dynamics. Hence chaotic synchronization is not possible as chaos 
requires a positive Lyapunov exponent ^ f . 



4.2 General pairwise coupling without quasi-isolated vertices 

To characterize this case we start with the following definition. 

^If one considers chaotic synchronization, i.e. f + eg is chaotic, then there exists subtleties concerning 
this open set and the exact notion of attraction. These issues are carefully studied in 14 . For the 
purposes of this article, these subtleties are not important. 
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Definition 3. The k-th mixed transverse exponent Xk is defined for 2 < k < n as 

t+T-l 

'T 



Xfe :-limT^o,i J2 log\hk{sm, (10) 

s=t 

where 

hkis{t)) = /'(s(<)) + edigisit), s{t)) + ed2g{s{t), s{t))Xk 
and t is chosen such that h(s{t)) ^ for all t > t. If no such t exists we set Xk = —oo. 

These exponents combine the dynamical behavior of the functions / and g with the 
network topology. Furthermore we define the maximal mixed transverse exponent x as 

X := maxxfe- 

fe>2 

The next theorem shows that the maximal mixed transverse exponent governs the syn- 
chronizabihty of the network. 

Tiieorem 4. System (J^l synchronizes if the maximal mixed transverse exponent is neg- 
ative. 

Before we prove this theorem we prove the following theorem that also holds for time- 
dependent functions. 

Tiieorem 5. Consider the system of equations 

v(t + l)-l ^iW^'W' ^ = 1' fll) 

1 A:i(t)i;,(i) + fc2(t)«.-i(i), z = 2,...,m, ^''> 

where Vi G M and ki and k2 are bounded functions on R. Suppose there exists i G M. such 
that 

ki(t) for t > 1 (12) 

Suppose further that 

^ to+T-l 

77 := limT-^ooT^ sup log |fci(s)| < 0. (13) 

^ to>i s=to 

Then for any e G (0, —77) there exists > such that all solutions of ill]) satisfy 

\\{v^{t), . . .,V,nm\ < i^ee(''+^)(*-*°)||(«l(io), . . ■,V,M)\\ (14) 

for all t > to > t. On the other hand, if there is no such t satisfying Iil2\} . then 

\\{vi{t),...,v„^{t))\\=0 for all large t. (15) 
Proof. The homogeneous equation 

vi{t + 1) ^ kiit)viit) (16) 
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has the sohition vi(t) — ^{t,to)vi{to), where the state transition function $ is given by 
to) = l\l=]o * > ^0' and t) = 1 for Vt. In the foUowing, to > 1 By mi), for 

any e e (0, — r/) there exists T' such that 



-, to+T-l 

sup - y fog |fci(s)l < 77 + — < 0, for all T > T' . 



Thus, 



whereas 



t-i 



t-1 



S = to 



where M = supjgjg Thus, 



t-i 



n ^ Ci"e(''+^")(*-*«), \/t>tQ>t 

s=to 

where the constant Cf > niax{M-^ e~ , 1} is independent of to. Consequently, 

|$(i,to)| < Ci^e(*-*«)(''+^^), yt>to>t, (17) 
and the solution of the first equation in pip satisfies 

\vm<Cle^^+^'^^'-'o^\v^{to)\. (18) 
Now the solution to pT]) for « = 2, . . . , to is 

t-i 

v,{t) = ^it,toH{to) + J2 + l)fc2(s)v^_i(s). (19) 

S=to 

Using (|17p and ^TE\i we estimate, 

|v2(t)| < (7fe(''+^^)(*-*«V2(io)| +C'f^X;l=toe^''^™'^^*"''"^^e(''+^'^)(''-*«)|vi(to)| 
= Cfe(''+^^)(*-*«)|w2(to)| + Cf'fc^e('"+^^)(*-*")e-(''+^^)(i - io)|fi(io)|, 
where /c2 — sup^ |fc2(t)|. Adding to (fTS]) yields 

|i^2(i)| + |fi(t)| < Cfe("+^^)(*-*«)|z;2(to)| + Cfe(''+^^)(*-*«)Cfc;e-("+^^)(t - to) + 1)1^^1(^0)1 

Since there exists some constant C2 (we drop the dependence on e for ease of notation) 
such that 

C[e("+™")(*-*°nfee~("+™^)(t-to) + 1) < C72e(''+™^)(*-*°), Vt > to, 

we have 

ki(i)| + \v2{t)\ < C2e^"+^'^^'-'°H\vi{to)\ + \v2{to)\), yt>to> t. (20) 
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For i — 3, the argument is similar with some sHght modifications: We use the estimate 
from (fT7|l as 

in (fT9|) . while bounding \v2{t)\ by the right hand side of ([20|) . Thus, 

t~i 

\v3{t)\ < Cie(''+^^)(*-*°)|i;3(to)|+C2 ^ e^'^+^'^^*-'~'^k^e^'^+^'^^'-'°\\v^{to)\ + \Mto)\). 
Adding to ([201) gives 

3 3 

1=1 1=1 
for some constant C3 . Repeating for i = 4, . . . , m, we finally obtain 



i=l i=l 

which establishes (fH)) for the ^i-norm, and thus for all norms in for an appropriate 
constant K^. 

To prove the last statement of the theorem, notice that if fails for all t, then there 
exist an infinite sequence < i2 < • • ■ of zeros of fci. In this case, the equations (jlip 
imply that Vi{t) = for alH > + 1, yielding (fT5|) . This completes the proof. □ 

Now we prove Theorem |4l 

Proof of Theorem [7} For general pairwise coupling and networks without quasi- isolated 
vertices, Eq. ([1]) can be written in the following form using the coupling matrix K 



x^it + 1) = fix.it)) + e (Kg(xi(t), x(i))), , 



(21) 



where the vector g(xi,x) G R" is defined as g(xi,x) :— igixi,xi), ...,gixi,Xn))^ and 
(Kg(xi(t), x(i)))j is the zth component of the vector Kg(xi(i), x(t)). 

Let x(t) = . . . , Xnit j) and s(i) = . . . , s(t)). Small perturbations u(t) — 

x(t) — s(i) of the synchronous state are governed by the variational equation 



uit + 1) = ifisit)) + ed,gisit), sit))] u(i) + e925(s(t), sW)Ku(i), 



(22) 



where dig denotes the ith partial derivative of g. 

In the sequel we study the coupling matrix K in Jordan form. There exists a non- 
singular matrix P such that K = PJP^^ and J is of the form 



/Ji 



(23) 
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Each Jordan block J; is of the form 



/ A, 1 



V 



1 



(24) 



where to/ is the block size of the Jordan block J;. Without loss of generality we assume 
that Ji corresponds to the eigenvalue Ai = 1 with eigenvector e := (1, 1)^. After the 
coordinate transformation, u{t) P^^u(<) =: v{t), Eq. ([22|) becomes: 



v{t + 1) = [f'{s{t)) + ed,g{s{t), sm v{t) + ed2g{s{t), s{t))3v{t) 
For each Jordan-block J; this reads in component form: 



V^it+l) = 



hi{sit))v,{t) + ed2g{s{t),s{t))v,+i{t) 
hi{sit))v,{t) 



mi -1 

i = TO/ 



(25) 



(26) 



This is exactly of the form with ki — hi and k2 — ^829- We now apply theorem 
[5l noting that the time dependance in (|26p arises from a trajectory of a time-invariant 
system, so choices of initial times are arbitrary. Thus, the perturbations decay for all 
Jordan blocks J^, i = 2, ...,to. For the Jordan block Ji the situation is different because 
we do not assume that the mixed longitudinal exponent xi (similarly defined as the mixed 
transverse exponents Xk in pO)) for the eigenvalue Ai = 1) is negative. Thus, viit) does 
not have to decay. However, we are mainly interested in the behavior of the original 
perturbations u(t) = Pv(i). Since Ai = 1 corresponds to the eigenvector e := (1, 1)^ 
it is possible to choose P such that 



( 1 P12 

1 P22 



P2ri 



\ 1 Pn2 



(27) 



Pnn J 



Thus, u(i) = Pv(t) is given by 

u{t) = vi{t)e + 



Since all the Vi{t)^ i 
lim \xi{t) — Xj{t)\ 

t—>oo 



2, ...,n are decaying we conclude that 

: lim \s{t)+u^{t) - {s{t) +Uj{t))\ 



lim 

t — ^00 



lim 

t—*oo 



PikVk{t) 

k=2 

n n 

'^ptkVk{t) - y^^P]kVk{t) 



k=2 



k=2 



l^s(i) + Vi(t) + ^PjkVk{t) 



fc=2 



□ 
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Remarks 6. 

• If in addition xi < then Vi{t) is also decaying. Thus the synchronous solution is 
attracting. Examples of attracting synchronous solutions are studied in Chapter\^ 

• Theorem^can also be formulated in terms of the eigenvalues of the graph Laplacian 
C In this case one only has to replace Xk by 1 ~ X'/^, according to equation 

In the following we study some special cases of coupling functions that appear com- 
monly in applications. 



4.3 Diffusive coupling with both quasi-isolated and non quasi- 
isolated vertices 

For diffusive coupling a synchronous solution always exists. So, here we may permit the 
coexistence of both non-quasi-isolated and quasi-isolated vertices in the network. The 
general diffusion condition ^ imphes that dig{s{t), s{t)) — —d2g{s{t),s{t)). Because 
this leads to a cancellation of the artificially introduced term in the coupling matrix K 
(1 when i = j and di = 0), it follows that, even when there are non-quasi-isolated and 
quasi-isolated vertices in the graph, small perturbations u{t) = x(t) — s(t) are governed 
again by the variational equation (|22p. and the same arguments apply as in section [4.21 
In this case the k-th mixed transverse exponent for diffusively coupled units is given by 



X^iff:=limT^^l ^ log|/zdiff(s(t))| (28) 



where 

ht^m) = f'{sm+ed2g{sit),smXk - 1) 

and i is chosen such that h{s{t)) ^ for all t > t. If no such t exists we set Xk^'^ = —oo. 

For diffusive coupling. Theorem [?] implies that system ^ synchronizes if the maximal 
transverse exponent satisfies 

xdiff:=maxx^iff<0. (29) 

Proposition 7. Assume that the function f is chaotic, i.e. has a positive Lyapunov- 
exponent fif. If 

• there exists more than one quasi-isolated vertex 



or 



• the network does not possess a spanning tree 
then the maximal mixed transverse exponent is positive. 

Proof. If one of these conditions if fulfilled then by Lemma O the multiplicity of the zero 
eigenvalue satisfies mo{C) > 2 and hence the multiplicity of the eigenvalue 1 of K satisfies 
mi(K) > 2. Consequently, Xk^^ = /i/ > for fc = 2, mo. □ 
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In fact, it is intuitively clear that the presence of more than one quasi- isolated vertex 
or the absence of a spanning tree will in general make chaotic synchronization impossible, 
because in those situations, there will exist pairs of vertices none of which can dynamically 
influence the other. Note, however, that Proposition [7] does not exclude the so-called 
Master-Slave configurations. 

A particular coupling function that arises in coupled map lattice models [151 is 

g{x^,Xj) ^b{f{xj) - f{xi)) (30) 

where b is some real constant. In this case it is possible to separate the effects of the 
synchronous dynamics / and the network topology: 

Corollary 8. System fll) with the coupling function L30\} synchronizes if 

^/ max log |1 + e6(Afe - 1)1 < 0. (31) 

This result was already obtained in undirected [5] and directed [6] networks, in both 
cases with nonnegative weights. 

Assume that the synchronous solution / is chaotic, i.e. /i/ > 0. Then the network 
topology term in pip has to be sufficiently negative to compensate the positive Lyapunov 
exponent fif. This in turn requires that the eigenvalues for fc > 2 be bounded away 
from one, and the coupling strength e lie in an appropriate interval. 



4.4 Direct coupling and only non-quasi-isolated vertices 

Another important special case of the general coupling function g{x, x) is the so-called 
direct coupling, where the interactions depend only on the state of the neighboring units, 
i.e. 

g{x^,Xj) = g{xj) (32) 

for some g : R ^ M. Thus dig{s{t), s{t)) — 0, and the k-th mixed transverse exponent for 
directly coupled units is given by 

:=fc^oo^'f:'log|/.direct(,(,))| (33) 

where 

h<^^^^Hs{t))^nsm+eg'is{t))X,. 

and t is chosen such that h{s{t)) ^ for all t > t. If no such t exists we set Xk^'^ = — cxo. 
For direct coupling, Theorem |4] implies that system ([1]) synchronizes if the maximal mixed 
transverse exponent satisfies 

^direct _ jna^ afreet ^ q (34^ 

Proposition 9. Assume that f + £g is chaotic, i.e has a positive Lyapunov-exponent 
fJ.(^f+^g) ■ If the network does not possess a spanning tree then maximal mixed transverse 
exponent -^direct positive. 



■^We borrow this term from 1161. 
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Proof. Similar to the proof of Proposition [71 □ 

If in addition g{x) — bf{x), it is again possible to separate the effects of the resulting 
synchronized dynamics (1 + eb)f and the network topology. 

Corollary 10. Suppose that g{x) — bf{x). System (QP synchronizes if 

+ At(H-e6)/ < 0. (35) 

Similar to the case of diffusively coupled units, if the resulting synchronous solution 
(1 + eb)f is chaotic, then the eigenvalues Xk should be bounded away from one, and the 
coupling strength e lie in an appropriate interval. 



max log 

k>2 



1 + ebXk 



1 + eb 



5 Emergence of synchronized chaos in directly coupled 
networks 

As mentioned in the introduction, in diffusively-coupled units, the synchronized network 
behaves exactly as a single unit would do in isolation. Hence, no new collective behavior 
is gained from synchronization: Either the units are dynamically complex, then so is 
the whole network, - or the units are dynamically simple then the behavior of the whole 
network will remain simple. 

Eq. ^ shows that the requirement for new emerging collective behavior is that the 
general diffusion condition Eq. ([2]) is not satisfied. In this way, the network can display 
new behavior that the single isolated units are not capable to show. In particular we shall 
see in this section that synchronous chaos can emerge in a network of simple units. 

One task in showing that simple units can exhibit synchronized chaos is to rigorously 
show that the synchronized solution is indeed chaotic. To this end, we consider S-unimodal 
maps. 

5.1 A full family of S-unimodal maps 

In general it is hard to prove that a function is chaotic. However there is one well- 
understood class of chaotic functions, namely the so-called full families of S-unimodal 
maps fl7'. For convenience, we recall the notion of a full family of S-unimodal maps in 
the Appendix lAl 

Properties of full families of S-unimodal maps: 
It is well-known that a full family of S-unimodal maps undergoes a sequence of period 
doubling bifurcations as fi varies from fiQ to /ii and finally becomes chaotic [171 118j . 

As the main result of this section, we present a full family of S-unimodal maps. 
Theorem 11. Consider the family f^ of maps 

(1tS^ + ^-TT^)^' (36) 

where Q < 0. This family is a full family of S-unimodal maps on [0,1] with /i G [fig = 0, /ii] 
where we choose /ii such that f^i^{c)j = 1. 
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Figure 1: Bifurcation diagram for Eq. (|36p with parameter values 8 = —1.3041 and 
^i = 20. 

The proof is given in Appendix IB] 

We can use the full family of S-unimodal maps to demonstrate that synchronous 
chaotic behavior can emerge in a network of simple units. Let the individual dynamics be 
given by f{x) = (^j^^:r^-x + 1^ Q and the interaction between units by g{x) = —ji^rjr^- 

Clearly, the individual dynamics are very simple, as f{x) has one single attracting fixed 
point. The resulting synchronous solution is 

sit + l)-{}^sit)^l)e-^^^. (37) 

If e = 1 and 8 < this is exactly of the form ([55)1 . Fig. 15.11 supports our finding in 
Theorem [11] and shows that Eq. ([57]) is chaotic for a wide range of e- values. 

For 8 > the family of maps p6p is not a full family of S-unimodal maps. However, 
computer simulations indicate that even in this case the Lyapunov exponent of p6p can 
be positive depending on the parameter values of 8,/x and e. For positive values of 8, 
Eq. p6|) can be used to model neural networks ^ . 

Another example of a full family of S-unimodal maps is given by the familiar logistic 
maps. In the next section we study in detail the emergent synchronous chaotic dynamics 
in networks of coupled logistic maps. 

5.2 Coupled logistic maps 

It is well-known that the logistic map 

£p{x) = px{l - x), p e [0, 4] and x e [0, 1] 

is a full family of S-unimodal maps. The logistic map is probably the best analyzed 
chaotic map; still not everything is understood rigorously. For convenience we briefly 
recall some properties. For p = 2 the dynamics of the logistic map are very simple, with 
the fixed point x = 1/2 attracting all points in the open interval (0, 1). The logistic map 
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tp undergoes a period doubling route to chaos [17j . At p = 3 the first period-doubhng 
occurs, followed by further period-doubling bifurcations with increasing values of p, which 
accumulate at p « 3.57. For p > 3.57 the logistic map can be chaotic but there are also so- 
called periodic windows in the parameter interval p G (3.57,4]. For p = 4 it is maximally 
chaotic with a Lyapunov exponent pi^ = In 2. 

We consider a network of coupled logistic maps. Let f{x) — aix{l — x), g{x) = 
a2x{l — x) and 

e=^. (38) 
a2 

Assume that ai,a2 G (0,4) and a;(0) G [0,1]. Then the dynamics of the synchronized 
solution is given by 

s{t + 1) = ip{s{t)) = ps(i)(l ~ s{t)). (39) 

For given ai and 02 the coupling constant e can be used to control the dynamics of 
the synchronous solution, i.e. e can be used as bifurcation parameter. In particular, 
synchronous chaotic behavior can emerge in the whole network, even if the individual 
dynamics are very simple. 

By an application of Corollary 1101 the directly coupled network of logistic maps syn- 
chronizes if 



max log 

k>2 



< 0. (40) 



P 

For illustration we consider some concrete examples. 

Example 12. Let f{x) = g{x) = ^2(2^)- Choosing e = 1 yields p = 4, and the synchronous 
solution s{t) — £4{t) becomes maximally chaotic. Thus, the whole network displays com- 
plicated dynamics although each unit of the network itself is dynamically simple. 

Eq. implies that the network synchronizes if all eigenvalues of the graph Laplacian 
(except \'i = Oj are contained in P(2,l). Within the class of undirected graphs with 
nonnegative weights, the latter condition can only be satisfied for complete graphs Ulf . 
However, for directed graphs or in the case of mixed signs there exist also non-complete 
graphs satisfying this condition U9\j . 

In the next example we choose different functions / and g that lead to the same 
synchronous solution. Interestingly, the condition on the eigenvalues is this time different 
than in the case of Example [T2l 

Example 13. Let f{x) = ii{x) and g = ^3(2;). Choosing e = 1 implies that the syn- 
chronous solution is the same as in Example llSl i.e. s{t) = £i{x). 

The network synchronizes if all eigenvalues ( except \\ — Q) of the graph Laplacian are 
contained in "0(1, |). Ln contrast to Examvle M'A there also exists non-complete undirected 
graphs with positive weights that satisfy the latter condition. 

Comparing Example 1121 and Example 1131 shows one interesting point. In both Exam- 
ples the synchronous solution s{t) and the overall coupling strengths are identical. How- 
ever, in Example 1121 the network synchronizes if all eigenvalues are contained in T>{2, 1) 
whereas the same is true for Example ll3l if all eigenvalues are contained in 2?(|, |). Thus, 
in contrast to diffusively coupled units, the synchronizability of a directly coupled net- 
work is not completely determined by the synchronous solution s{t), the overall coupling 
strength e and the network topology (i.e. the eigenvalues of the coupling matrix), but 
depends also on the special choices of / and g. Clearly, this can already be seen from the 
definition of Xsl^''^'^*- 
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6 Suppression of chaos 



Besides the emergence of chaos in a network of simple units, the opposite is also pos- 
sible. In this section we show that non-diffusive coupling can also be used to suppress 
chaos. Chaos suppression in single systems is a well-established field; for an overview see 
[20j and the references therein. In our setting, suppression arises in networks through 
synchronization of the states of the units. 

As a first example, we consider a network of directly coupled chaotic logistic maps. 

Example 14. Let f{x) = g{x) = £4(2;) be given and choose e = — l). This choice 
implies that the synchronous behavior is given by s{t) — £2. lit) o-nd is non-chaotic. Corol- 
larv \10\ imvlies that the network synchronizes ij all eigenvalues of the graph Laplacian are 
contained in P(— 1.11, 10.99). 

Example [TJ] shows that the network synchronizes for a wide range of eigenvalues AJ, . 
Compared to synchronous chaotic behavior, studied in Example [T^ and [T51 the radius of 
the disk T> is much larger for simple synchronous behavior. The reason can be seen from 
condition (j35p : A smaller Lyapunov exponent for the synchronous behavior implies less 
restrictions on the allowable values of AJ. . 

Lemma [1] implies that all eigenvalues of C are contained in the disk ©(l, r). For suffi- 
ciently small r the latter disk is contained in P(— 1.11, 10.99). So, instead of calculating 
all eigenvalues of the coupling matrix, the knowledge of the radius r can be sufficient to 
determine whether the network synchronizes. Hence, the quantity r already gives some 
insights concerning the robustness of the synchronous state. 

Motivated by the above example, we will give in the next section sufficient conditions 
for synchronization in terms of r. In fact, these conditions will not depend on the eigen- 
values of the coupling matrix. Again, we want to point out that this is only possible if 
the synchronous behavior is not chaotic. 



6.1 Direct coupling 

We restrict ourselves to the case of direct coupling where g{x) = bf(x) 
Corollary [To] and Lemma [1] that the network synchronizes if 



Ai(i+£&)/ < log 



l + eb 



1 -1- |e6|r 



It follows from 



(41) 



Again, we see that a simpler synchronous behavior in the sense of a smaller Lyapunov 
exponent implies that the network synchronizes for a large class of network topologies. 



Example 15. Let f{x) — g{x) = ii{x) and choose e = 
s{t) — ip{t). By Eq. 114 the network synchronizes if 



(f 



1) . This choice implies that 



log 



4 




- + 




P 





< 0. 



(42) 



The left-hand- side of 114 is plotted in Figure\^ 

• For p = 2, X* = 1/2 is an attracting fixed point of s{t) = £2{t) that attracts all 
points in the open interval (0, 1). For x(t = 0) = G (0, 1) we have 



,{t) = l/2[l-{l-2xo) 
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Figure 2: Plot of \xi^ + log ^ + (| ^ function of r. The dot-dashed line corre- 

sponds to the parameter value p — 3.25, the dashed line to p = 2.5 and the solid line to 
p = 2.l. 



Because of this fast convergence to ^, the fact that ^2(5) — implies that fig^ = 
—000 Thus the network synchronizes for all network topologies. 

• For p — 2.1 and p — 3.25 the solid and dot-dashed line in Fig. [H show that the net- 
work synchronizes for all network topologies that satisfy r<8orr<12 respectively. 
In comparison to Example | here we only use the information given by r instead 
of using all eigenvalues of the coupling matrix. 

• For p = 2.5 the dashed line in Fig.^shows that the function pi^ 5+log | + {yE ~ l) ^ 
is never negative. Hence estimates based on r are too crude to obtain synchroniza- 
tion information, however in such a case we can use Corollary \10\ to conclude that 
the network synchronizes if all eigenvalues AJ, of C ( except X'l — Q) are contained in 

a disk centered at —5/3 with a radius 10/3. 

Finally, we give an example of synchronization independent of network topology when 
all the weights have the same sign. 

Example 16. Let g{x) — bf{x) be arbitrarily maps. Assume that all weights in the 
network are either nonnegative or nonpositive, i.e. r — 1. If eb > then condition 
is satisfied if 

/X((l+eb)/) < log 1 = 0. 
If eb < then condition J/^ j[ ) is satisfied if 

/^((l+ef,)/) < log 

^Because of this property, some authors call the fixed point i superstable. [21) . 



1 + e5 
1 -efe ' 
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7 Conclusion and discussion 



In this work we studied complete synchronization in coupled map networks of identical 
units. We have generalized synchronization analysis to directed networks with both posi- 
tive and negative weights and general pairwise coupling functions. This generalization is 
especially important for analyzing real-world networks. For example, in neural networks 
the coupling function is non-diffusive. Excitation and inhibition are modeled by positive 
and negative weights, respectively, and only the pre-synaptic neuron influences the post- 
synaptic one but not vice versa. Thus, directed networks with signed weights are needed 
to model neural networks in an appropriate way. 

We have derived sufficient conditions for local synchronization, which are expressed 
in terms of the maximal mixed transverse exponent. We have shown that, in contrast to 
diffusively coupled units, non-diffusively coupled networks can display new synchronized 
behavior that the individual unit is not able to show. The new synchronous behavior is 
influenced by the overall coupling strength that plays the role of a bifurcation parameter. 
Again, this is important in neural networks. Changing the coupling strength in a learning 
process allows the network to learn new, possibly much richer behavior than before. 
In particular, synchronized chaotic behavior can arise in networks of non-chaotic units 
with non-chaotic interactions functions. Conversely, chaos can be suppressed through 
synchronization in networks of chaotic units. This may have practical implications in 
the field of chaos control. Often chaos is controlled by applying time-delayed external 
feedback. In our approach chaos can be controlled by changing an internal parameter of 
the system. 

There exists natural extensions of this work. One direction is to generalize the synchro- 
nization analysis to networks of non-identical units. Here the problem is more challenging, 
since complete synchronization is usually not possible, and one must look for other suitable 
types of solutions and investigate their stability. Other directions for extension include 
higher-dimensional and/or continuous-time systems. In all cases, the possibility of the 
emergence of new dynamics via synchronization offers a helpful perspective in our efforts 
to understand complex systems. 

A Definition of a full family of S-unimodal maps 

Definition 17 (Unimodal Map). Let / : / = [0, 1] ^ / = [0, 1]. The map is unimodal if 



2. f has a unique critical point c (i.e. f'{c) = 0) with < c < 1. 
Definition 18 (Schwarzian Derivative). The Schwarzian derivative of a function f at x 



The important role of a negative Schwarzian derivative was discovered by Singer [22] . 
A negative Schwarzian derivative restricts the number of stable periodic orbits. Singer 
showed that a unimodal map whose Schwarzian derivative is negative has at most one 
stable periodic orbit. Furthermore, if the critical point is not attracted to a stable periodic 
orbit then the map has no stable orbit at all. 



1. /(0) = /(l) = 



IS 
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Definition 19 (Itinerary). Let x E I. The itinerary of x under f is the infinite sequence 
S{x) =^ (.S0S1S2, ...) where 




if P{x)<c 

1 if f^{x)>c 
C if f^{x)^c. 



The idea of kneading sequences goes back to Milnor and Thurston [23] . 

Definition 20 (Kneading Sequence). The kneading sequence K{f ) of f{x) is the itinerary 
offic), I.e., K{f) = S{f{c)). 

Definition 21 (Full family of S-unimodal maps). Let he a family of unimodal maps 
with fiQ < /I < /ii . is called a full family of S-unimodal maps if 

1. f^o{x) = for all X E I. 

2. When fi = fn, K{f^,) ^ (1000...). 

3. S f^{x) < for all /i > /Iq and x G I . 



B Proof of Theorem [TT] 

Proof. It is straightforward to show that is unimodal for all /z. The first two points in 
Definition \n\ obviously hold because /^^(c) = and is a fixed point. So we only have 
to prove that Sff^{x) < for all ^ > fia = 0. We calculate the following derivatives. 



1 + e-^ (1 + 6-^^)2 



/;(x) =2^i^Qe-^^ 



1 



1 



Putting a 



and b := a(l 



g-p2^)2 

1 



(1 + e-^^)3 



fi:'(x) 



(l + e-A'2^)2 (l + e-^^)3 
p-t^xy _ 2^e~''^, we have: 

-fj.x\2 



(1 



24^* e 



2a^i^e-^'''{^ + e"^^)^ + ifi^e'^'"'' + 12a^3e-2'^^(l + e"''^) 

4 — 4 j; 



4 -3aij; 



1 



,4„-2/i2: 



-6/i e 



12a/i e -r j]^^g-nx-)2 
24/i4e-3^^ 24//e-4A'^ 



+ 



Thus, the Schwarzian derivative 

.C(^) 



Sff^ix) 



1 



(1 



3-^13; ")2 



-2ay?e-^''' 
<o 



/AW 



-2fix 
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is negative if gfj.{x) > 0. The critical point of .9^(2;) is given by 



It is easy to verify that this critical point c is actually a minimum of the function 5^ (x) . 
First, we assume that c e (0, 1). This leads to 



e-^ < 2 - £ < 1. (43) 



Inserting the critical point yields: 




< 1 

So we only have to check that gii{x) > at the boundary. First we consider the case 
x = 0. 

u 1 + 

.,(0) = -2+^.-2+^— 

Calculating the minimum of (7^t(0) with respect to /i yields: 

dfi 1 - e-^ (1 - e-^)2 

1 - 2^e"^ - 6^2'" = 

Hence, we see that /i = is the minimum. Using I'Hospital's rule we obtain: 
lim gJO) = -2 + lim ^'^^^^'"^ = -2 + lim ^ + ' ^^'^ ^ q 

This shows that g{0) > if /i > 0. The case x = 1 is treated in the same way. Thus the 
family (|36p is a full family of S-unimodal maps. □ 
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